Improved Parameter Estimation for First-Order Markov Process
نویسندگان
چکیده
منابع مشابه
Subset Selection for Improved Parameter Estimation
In this paper we discuss methods for subset selection for a non-linear least squares parameter estimation problem. Through the use of these algorithms, we partition the parameter space into a linear independent and a linearly dependent set. By identifying these subsets, we are able to gain further into model dynamics. We then apply subset selection techniques to a simplified model describing th...
متن کاملLearning first-order Markov models for control
First-order Markov models have been successfully applied to many problems, for example in modeling sequential data using Markov chains, and modeling control problems using the Markov decision processes (MDP) formalism. If a first-order Markov model’s parameters are estimated from data, the standard maximum likelihood estimator considers only the first-order (single-step) transitions. But for ma...
متن کاملHigher Order Markov Networks for Model Estimation
The problem we address in this paper is to label datapoints when the information about them is provided primarily in terms of their subsets or groups. The knowledge we have for a group is a numerical weight or likelihood value for each group member to belong to same class. These likelihood values are computed given a class specific model, either explicit or implicit, of the pattern we wish to l...
متن کاملFirst-Order Markov Decision Processes
Markov Decision Processes (MDPs) [7] have developed lately as a standard method for representing uncertainty in decision-theoretic planning. Traditional MDP solution techniques have the drawback that they require an explicit state space, limiting their applicability to real-world problems due to the large number of world states occurring in such problems. Recent work addresses this drawback via...
متن کاملRecursive parameter estimation for categorical process control
Statistical process adjustment (SPA) is utilised prevalently in novel manufacturing scenarios. When quality characteristics rather than internal process variables are inspected for the purpose of quality control, data with different resolutions may be collected. This paper proposes a Bayesian framework for parameter estimation when only categorical observations are available. The proposed metho...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Research Letters in Signal Processing
سال: 2009
ISSN: 1687-6911,1687-692X
DOI: 10.1155/2009/186250